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ABSTR ACT 

It has generally been shown that the high school 
record is the best single predictor of college-level achievement, and 
that the most valid predictors accrue when high school record 
information is given more weight than selection-test scores in 
admissions decisions. In actual admissions practice^ however^ test 
scores are often given the most effective weight. In the first part 
of this report^ four main points are made in connection with past 
studies on college admissions. Results from a study carried out in 
Texas by the authors is reported in which the focus of attention was 
on standards and policies that govern admission to post-secondary 
education. It was found that exclusive use of either a high school 
grade-point-average or a high school rank did not provide optimum 
prediction of college grades. The authors concluded that in making 
college admissions decisions and recommendations, it is generally 
best to use a carefully obtained high school rank in conjunction with 
an empirically developed high school transcript score in the 
prediction of college achievement. In the presence of these two 
indexes, used jointly, selection test scores become redundant. 
(Author/PC) 
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Foreword * 

Althoas'i acade*nic aptxtade and "intelligence" remain as interesting 
theoretical concepts subject to farther refinement, it is now ^e^nnln^^ to appecir 
that these constructs are not necessary ones, at least with respect to college ad- 
missions. E5ven for the purposes of classifying exceptional children, the neces- 
sary use of educational and psychological tests is being increasingly questioned. 
Based on the fmdin^^s discussed in tne v/idely-noticed Hobls Report, Nicholas liobbs 
recooinnends that tests should not be used at ail, generally, except for research 
purposes. He warns that "categories and labels are powerful instruments for so- 
cial regulation and control, and they are often employed for obscure, covert or 
hurtful purposes: to degrade people, to deny them access to opportunity, to ex- 
clude * undesirables' whose presence in some way offends . . ." (T he Fit ires of 
Children , Jossey-I^ass, in press). To the maxi.nxT:! extent feasible, "inamstreaming" 
is recoin-nended. 

Testing for college admissions, and for college counseling and guid- 
ance, IS an especially costl: enterprise. At almost any large, urban high school, 
students and their parents spend, each year, as much as ^15,000.00 to pay the 
"non-profit" testing agencies for the opportunity to take one (or sometimes both) 
of the commonly-used college entrance examinations. In a moderately-sized met- 
ropolitan area (such as m San Antonio, Texas) the yearly sam can be more than 
3150,000.00. In an area as large as Texas, the total amount can be as Tiuch as 
$1,500,000.00 each year. 

Some parts of tiie above amounts, again each year, go to high school 
and college counselors who are, in some unspecified manner, selected to give the 
examinations. Larger parts of the abce amounts go to help finance the research 
and publication effor-^s of test-oriented professionals. Strategically-located 
persons in higher education, including many with no particular expertise in tests 
or testing, are asked to serve on advisory boards of the testing organisations. 



and are invited to attend interesting- parieyy tliat are not inexpensive, lojisti- 

cally. At one of ti;Gse (in May, 1974) to mark the dedication of a new conference 

center at Princeton, New Jersey, the President of the ikiucational Testing? Service 

jokingly recited thia little verse in his opening remarks: 

There was a yoong lady of Kent, 

iiho said that she laiew what it meant 

Vlhen men asked her to dine. 

Gave her cocktails and wine. 

She knew what it meant, bat she went. 

Ilany of the procedures now used in the selection of students for higher 
education were devised and adopted v/hen co:nputers were in a rather neolithic sta^je 
of development. This report ends with a modest proposal that new attention be 
eiven to the secondary-school record as an economical and more comprehensive source 
of information for predicting college achievement, and that advantage be tsken of 
computer technology* in exploiting this information. The recommendations incl ide 
one offered as a partial solution to the "hierarchy" problem among educational 
institutions at the college and university level. 

It was in San Antonio, Texas, that a three-judge panel ruled in favor 
of Rodrigueii (reversed 5-4 by the Supreme Court). Hot all the Rodrigiez children 
in the San Antonio metropolitan area reside in the Bdgewood District, nor are they 
all Brown. Serious thought is now being given, state-wide, to the matter of equi- 
table financing of schools. It seems quite likely, however, that the terms local 
control , local enrich-nent , and individial needs will often be serving as code words 
for a continued non-agreement with what the courts have been trying to say. A few 
school board members, especially those in the more affluent suburban areas, are 
now displaying an uncommon interest in test results, and in any other information 
that can be used as a reasonable and publicly-justifiable pretext for treating 
children differently. 

iv *i 
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A New Look at the llisn School Record as a Soarce of Information 
for Predictinej College Achievement 

Chester J, Judy 

A socially relevant problem periodically receiving more than a minim;LTi 
amount of attention is one pertaining to college admissions. There is much dif- 
ference of opinion regardin^^^ the number of youn^ men and woTien in the total pop- 
ulation that should be planned for, accepted, or received, this rrn£p.ng fro'n the 
number of the "academically talented" only, as lev; ns 15 per cent of the present 
number of secondary school graduates propounded by a few non-egcilitarian writers, 
to as many as 100 per cent of the na:iiber of those graduated. In 3uropean coun- 
tries, where much smaller percentages are in the possible range, the question is 
a matter of the fair sharing of existing space, an issue never satisfactorily re- 
solved, and one to which new thought is being given (Bereday, 1973)* In those 
countries there is an increasing level of conflict between traditions that guar- 
antee a university place for every jPciduate of a "higher" secondary school and the 
perceived economic need for a numerus cl.rus is (the Latin phrase for restricted ad- 
missions). Many ^'uropeans are dismayed when they learn about the American system 
of pre-college testing and "interviewing." At the same time, in many places, there 
is some movement away from the practice of channeling students into different types 
of secondary institutions at about the age of eleven or twelve. A common curricu- 
lum in a "common" school (now becoming somev/hat less common in American secondaiy 
education) appears to be one of the intermediate goals in several places. 

In the United States the administrative trend, on the long term, has 
been toward the expansion of higher education facilities so that larger numbers 
of young people might be able to attend some college, at least for one or two 
semesters. Increasingly, however, the annual contest is for admission to the 
"better" institutions, those described by Bereday (p. 42) as "pockets of struggle 
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over cid'nission'' which "reproduce in miniatire the tensions existing; on a national 
scale m elitir,t comtries/' (Once accepted, a student's chances for sirvival in 
American hi^jher education are, paradoxically, mach better at the prer>tii;io an loca- 
tions*) The intensifyinj competition is not sarprisirij in view of the expc^ndin^ 
awareness of the economic and social advantages that accrae to yo m^^ people who 
attend the more selective schools. This is not to say that all the best instric- 
tion is ijiven at elite colleges and universities, or that the c irricilam and the 
physical plant at some of the lesser knowr. places in the Lnited States are always 
incomplete or inadequate. On the matter of the "quality'' of the student body, 
so.ne of tne students in a typical colle^^e at the "lower" end of the American hier- 
arcliy typically have academic qualifications equivalent to the qualifications of 
the avciafje applicant ceremoniously admitted to schools at the "higher" end. A 
more conspicuous difference between the institutions at the two ends of the hier- 
archy is often the ma^itude of the student-faculty ratio or the student-tutor 
ratio. Some critics of hi^jher education maintain that rising tuition and livin,«j 
costs are now servinj to reestablish prestigious campuses as enclaves for yoinj 
people from wealtiiy and influential family backgrounds. In some places, however, 
finmcial aid plans are pernittini; the enrollment of more students from "poor" 
backjrounds. The present trend is tov^^ard fewer students from middle income jroups. 

When a college or university, any college or university, admits some ap- 
plicants and rejects others, a question often asked is: How are these decisions 
made? Or: How should such decisions be made? Many informed people in the acci- 
demic community, and also in the larger body of educated laymen, believe that the 
fairest basis for admission is one on merit that favors applicants in accordance 
with the Lest possible estimate of their relative prospects for doing well in a 
particular ^cadernic setting. Admission test scores (such as those on the Scholas- 
'**c Aptitude Test developed for the College Entrance ISxamination Board or tests 
produced by the American College Testing Program) have, in the last 25 yoars, been 
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accorded special status as cicceptable predictors of achievement at the college lev- 
el. Academic achievement m high school (usually high school grade-point-average 
or rank based on that average) is also widely recognized as a "good" predictor. 
Although the catalogs of selective colleges sometimes give the impression that 
careful thought is given to a broader range of qualifications, and although other 
information is sometimes actually used in the development of selection equations, 
such information generally adds only a trivial ainount to the predictive utility 
of test data and/or the high school record. This is true even though test data 
and/or high school record data, in their very best present applications, can be 
used to account for only a moderate amount of the variation in college performance. 

iluiidreds of studies have shovm that prediction of college achievement 
based upon a weighted combination of test results and information from the high 
school recoi-d (such as high school rank) are more accurate than predictions made 
from test scores alone, or from the high school record alone. These studies have 
also generally shovm that optimum prediction is obtained \<hen more consideration, 
or weight, is given to high school record information than the test informa- 
tion. Hoyt {1968), for example, in a sampling of fifty colleges, found that the 
best-weight equations for predicting college grades ranged from weighting test 
scores and high school grades in the ratio of 1 to 0.7, to weighting test scores 
and high school grades in the ratio of 1 to 3.2, with a median ratio of 1 to 1.2. 
This particular study was sponsored by the American College Testing Program. The 
median ratio of 1 to 1 .2 for weighting test scores and high school grades was used 
in developing "general" prediction equations (one for men and one for women) for 
each of 985 four-year colleges. 

Several points should be made in connection with the earlier studies on 
college admissions, including the one conducted by Hoyt. The first and most im- 
portant 13 that it is not at all clear that an "average" grade completely or ade- 
quately represents or summarizes the heterogeneous content of a "high school 
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record/* An "average" ^rade macks important differences with respect to the coirses 
different students taice. The lack of standard approachej to the computation of av- 
erajes, and the coioon scarcity of effective review procedures f')r correctin^j or- 
dinary computational errors, contribute farther to the unreliability of "grades." 
(In this report, quotation iiarks will generally be used with the terms hich school 
£;rades and higTh school record to show that the inLended reference is to one of the 
presumably less-tlian-optimum, but commonli'-ased , measures of secondary-school 
achievement.) The assembly, treatment, and use of test data, on the other hand, 
is not so undisciplined. This leads to the initial observation that a ratio on 
the order of 1 to 1.2 for v;ei^htinj test scores and "high school grades" may be a 
somewhat conservative one with respect to the last val ^e in the ratio. Any im- 
provement in "grades" data will operate to increase their relative weight in best- 
weight equations of the kind developed by Hoyt and other careful investigators. 

A second point in connection with the findings of past studies on col- 
lege admissions is that the recommended ratios for weighxing test scores and the 
"high school record" are empirically derived. Whatever the deficiencies in grades 
or grading, the recommended ratios reflect the existin,,^ utility of the educational 
data in best-weight prediction equations. It is often erroneously inferred that, 
relative to "high school grades," test scores are more dependable and valid for 
selection purposes because of known differences in grading practices and standards. 
Th:;re are differences in these practices and standards, but the differences, though 
quite large sometimes, are not generally large enough to justify the negative in- 
ferences commonly made. 

Although almost all best-weight selection equations clearly indicate 
otherwise, test scores are usually given more consideration than "high school 
record" information when college admissions decisions are made (V/ing and V/allach, 
197 !)• The same thing occurs in certain other selection decisions (Judy, 1959) • 
Apparently, a substantial and critical number of people in education underestimate 
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the predictive utility of educational records, Goslin (196?) found that the more 
psychometric training teachers and counselors reported having, the more likely they 
are to rely upon ''aptitude" scores as the principal factor in counseling and place- 
ment recommendations, and the more likely they are to • cc«pt the idea that differ- 
ences in aptitudes tend to be rather fixed charac . .tics sliowin^' the "important" 
or "real" differences between students. There seemi; to be no shortage of profes- 
sional opxnion tnat reflects considerable confidence in, and traditional reliance 
upon, "aptitude" or "ability" scores. This carries tnrou^^h all the way to the 
testing done for admission to ^aduate-level education, at which place and time 
the previous academic record has become a rather leng^thy one. 

Some vnriters ^ive socio-political reasons for the emphasis on "ability" 
testing in educ^ition settin^js up through the secondary level. Mercer (l974) for 
example, noting that the educational system is the primary institution for allo- 
cating persons to adult social and economic status, maintains that tests serve 
important "latent functions" in education, one of which is to affirm and perpet- 
uate the status of pei'sons i. subordinate, culturally different, or disadvantaged 
groups. Testing, Mercer observes, has the objective consequence of assignin.5 dis- 
proportionate numbers of young peoole from particular groups to educational pro- 
grams and tracks v/hich have low ceilings and which provide limited access to 
higher education. She also has some interesting coinments on the "cooling out" 
role of mental testing in educational settings. 

Tyler (l973)i in a presidential address for the American Psychological 
Association, relates that "reputable psychologists [now] argue that intelligence 
tests do not measure intelligence, and never have" (p. 1023). One of the prin- 
cipal gains of the last few years, unfortunately not yet fully subscribed to by 
many people in education, has been the greater realization of the subtlety and 
complexity of the forces that combine to determine relative standings on tests of 
intelligence or mental ability, or of "academic aptitude," The response to this 
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particalcir realization hau not ^et been a noticeable .nodif ication of widely-held 
notions on the special utility of tests for colle^jo admissions. 

There has been, in the last few years however, a somewhat greater will- 
in^GiJS to consider the use of "modified" college admissions policies for persons 
in some of the larger minority groups, bat these policies have tended to draw at-- 
tcntion away from the unused predictive utility of secondary records. In several 
places, major efforts have been made to develop special admission schedules for 
the matriculation of members of specified gi'oups, all jsing test data as the crit- 
ical information. A modified approach of this kind does seem to be justified ly 
the spuriois circunstance that aptitude tests predict about as well (or sometimes 
better) withm important minority groips as they do within groups made up, exclu- 
sively, of otiier identifiable persons. The circumstance is also cited in justi- 
fying the statistical efforts that have been made by test-oriented persons and 
agencies to mcike selection recommendations, those based on testing results, more 
"fair" under difx'erent assumptions of what constitutes fairness. Consensj,'^ con- 
cerning the use of modified selection procedures in colle^^ • admissions has not yet 
been reached, and this does not seem likely any time soon. In the meantime, dif- 
ferences in average test performance between groups continue to operate on a 
rather large scale to the disadvantage of many young persons. Contrariwise, it 
is sometimes pointed oat that provisions for quotas, or statistical procedures for 
modifying selection equations, tend to become inmanageable or confusing when it 
is possible to identify more than a few special groups, and that, in being more 
"fair" to some applicants, an admissions officer or selecti^^n committee becomes 
less "fair" to others. It is also sometimes noted that when such modifications 
are made, there is a necessary reduction in the overall effectiveness or efficien- 
cy of the total selection operation. 

A related matter, especially in some of the larger state systems of high- 
er education, is the policy on admissions in which th^. relative weight of test 
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data and information on uecondar^ perfornuince hay been established and publicly 
annoonced. This quasi-le^jal arranjeincnt is often mde when enrollment control 
measures, in an acknowledejed hierarchy of titate institutions, are thought to be 
desirable. The main trouble here, however, has a^'am been the aimoist iniversal 
practice of adoptin^; axxiliary rales that modify the effective wei^-hts of the se- 
lection variables. The niinori ly-majority matter may or may not be at issue. But 
when .iiiniinam test scores or .nininim hi^^'h school ^-ra^ie averages (or class rank), or 
both, arc specified m the announced aumission requirements, restilction in ran^je 
on tiiose variables is introduced. ..'hen this happens it is very unlikely that end 
results in selection vail closely resemble the selections mandated by selection 
formulas supposedly in effect. Lias in favor of test data, at the expense of in- 
formation on secondary performance, a^jain generally prevails. When cut-off scores 
are arbitrarily fixed btlow which no applicants are acceptable is to put tests to 
purposes for which they v;ere not developed. 

A third point in connection witii pact studies on colle^^^e admissions is 
ihat even the best wei^jnts ^iven to tne test predictors do not permit forecasts 
of college achievement that are particularly accurate. Actually, not more than 
about a tnird of the variation in college performance can generally be predicted 
tnroui^'h the use of test scores and "hi^n school recoi-d*' information. (if, for 
example, the relationship between college performance and these two kinds of in- 
formation can be represented by a multiple correlation (ii) value of .55, properly 
corrected for restriction in range on the selection variables, then = .30. 
Multiplying the .30 value by 100 shows that only 30 per cent of the variation in 
college performance is accounted for.) It is obvious, then, that there is consid- 
erable room for improvement in the prediction of college-level achievement, and 
that who goes to college, and exactly wnat college applicants get into, is, in 
some large part, not explained by the available ''qualifications*^ data. Some mod- 
erately selective colleges and universities are now setting aside special periods 
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(e.g., a su.n'ner quarter) when hic'n school jridaates with "low" selection tost 
scores cire ^Jiven an opportanity to defnonstratc the "capacity" for doin^ college 
work. 

A fourth and final observation is tliat, historically, for tne pjirposei5 
of academic pre'liction, mach inore attention has been jiven to tho meas :re.Tient of 
"inteili£:cnce," ".cental ability," and "scholastic aptitaie" thcin to the qar.ntifi- 
cation of any equivalent a.nount of data obtainable fro::i the existmj ^oade.nic 
record, data extendinj over a lon.jer sample of an individual's functioning tlian 
two or thi-ee nours of test behavior. In test construction, methodij of ite.n-r>e- 
Icction and test-ref me.nent have been carefully studied and routinely ised for al- 
most seventy yeai's. On tlie other hand, almost no effort has been devoted to tiie 
identification and quantification of significant iteny of infomation on existing 
school records, or to the identification of items which ^should be jiven effective 
weae;li't m arriviuj at a suipmary record "score." Persons in colle^je adTiissions, . 
includmj those with resc;arch responsilili ties on the topic, see.n to have jiven 
little attention to this mat ♦^r. They centime to recommend, and they apparently 
are satisfied with, the auxiliary use of ^jrade-point-avera^jes and rank in hi/;h 
school class to juide admissions decisions. It is fair to observe, hov/ever, that 
investigators in other topical areas often employ even less precise "measures" of 
educational accomplishment, such as "educational level" or "years of education," 
for use in investigations in wliich relationships between "education" and certain 
post-academic perf ormiinces are studied. Not surprisingly, the obtained relation- 
ships are usually not large enough to be of any practical significance. 

ijiiucational institutions tend to be ranked, and they rank themselves, on 
the basis of the "quality" of the students they are able to attract. Some critics 
argue that programs}, policies, and publications of the testing agencies themselves, 
and individuals with vested interests of one kind or another in testing, serve to 
oupport and popularize the role of testing in defining and establishing the prns- 



tlje hierarchy amon^ Arnerican collejos, and in preserving; col loco admissions as 
one of the major test-anchored areas of American life« Average score on the com- 
monly used admissions tests is widely accepted as a meaningful inrlex of the de- 
sired ''quality." Astm (U7l), in one available pullication, provides those data 
for 230c American colle^'es. Accordm^^ly , it is rare for a selective school to 
admit significant numbers of applicants with "low'* test scores^ 

On the other nand, equivalent data on the hi^Th school acco.-iiplishirients of 
studcnto admitted to the varioas colletTes and universities of the country have not 
been made availcible, nor have they teen reported in any useaLle format. At best, 
a student's hijh school rank or raw ^jrade-point-avera^^e is available amon,^ the 
auxiliary data, but it is not possible to relate this "record" in any systenatic 
or precise manner to the "recoi-ds" of other stidents who have been admitted to a 
particular college or university, as it otherwise is v/ith respect to te.t scores. 
Very little has been attempted, in any context, state, or country, to develop a 
more satisfactory summary measure coverinj the secondary-school record, or to 
make relevant comparative data available on an existing nc iher of post-secondary 
institutions. 

OL^octives of this otidy 
The scheduling* of the present investigation was suggested, in part, by 
the opening of a new branch of the university of Texas at San Antonio, Texas. A 
large campus for the University of Texas at San Antonio (UTSA) is now under con- 
struction. There are four non-public colleges and universities in the city (St. 
itoi-y's University, Trinity University, Our J idy of the Lake College, and Incarnate 
Word CoUego) having a total of about 11,000 students, and two public junior col- 
leges (San Autonio College and St. Philips College). The largest of the two-year 
colleges, San Antonio College, has a total enrollment of almost 20,000 students, 
more than the number of students enrolled at all the other institutions combined. 
Because of construction delciys at the new UTSA campus, and because of advances in 
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the date when 'onder^^rad late stadents can be accepted (now projected for the Pall 
of 1976), proispective oToA titadents have been encoara^^ed to begin their post- 
secondary projru;ns at Jan Antonio Collei^^e. Apparently, many have chosen to do 
so. The principal 3oarce of the data for the present study was the hi^;h school 
recoixls of a sam^^le of fall-time, freshman students at San Antonio College. 

In several ways, the situation in higher education in the San Antonio 
metropolitan area i« a microcosm of ni^^her education in the State of Texas, and 
to some extent, in the nation as a whole. There is, for example, the on^oin/j ex- 
panjioa in education facilitic:? so thai everyone, or almost everyone, v;ho wishes 
can find a place in some colle^;e or university. There are different admission 
policie53, and the same possibilities for differences of opinion over how these 
policies do, or should, relate to one anotiier. To some degree there is an ex- 
isting prestige hierarcJiy among San Antonio colleges and universities, and, v;ith 
no change in stated admission policies, the hierarchy will prol.a> ly 1 ecomc a more 
pervasive one. Tacre is tlie concurrent problem of how to be fair to an impor- 
tant naml'or of "minority'' students. There is a parallel existence of privately- 
supported and publicly-supported institutions, and the financial and organiza- 
tional problems faced by the private instititions where fees must necessarily be 
higher than those asked at the public colleges. There is the same necessity to 
coordinate progranu>, policies, cind curriculums so that there will be a public 
perception of minimum duplication and waste .\n the total amount of resources for 
higher education. Instruction is, or will be, carried out at two-year, four- 
year, and university-level institutions. There is the same obligation to view 
the higher education enterprise, in its total configuration, as an important 
means for providing for the optimum development and education of all students. 
As elsewhere, the most important innovations in higher education are the possible 
ones that begin with a reassessment of what goes on at the admission gate. 

This, then, is the developing milieu in which the present investigation 



11 



was planned. From the perspective of the current state of the art for colle^je 
admissions, there is, here, both an opportunity and, it seems, almost an obliga- 
tion to take a new look at the hi(;h school record as a source of information for 
predictiutj college achievement* Are the accepted generalisations concerning the 
relative atility of test scores and information from the "hi^h school record" 
true in the local sitaition? Does the use of a high school "grade-point-average" 
(K3A), or rank based on that average (iiSll) lead to erroneous conclusions concern- 
ing the .naximum predictive utility of measures derived from the previous academic 
record? It is believed that answers to these questions v/ill have important im- 
plications for educational practice both here and elsev;here* 

In the process of attempting to find an ansv;er to the last of the above 
questions, u high school transcript score (ilSTS), a h^'pothetically better "mea- 
sure" pertaining to the high school record, is generated and evaluated in context 
with other information of the kind normally employed in making recommendations 
and decisions on college admissions* Before proceeding v;ith a description of lac 
procedures ased in this task, i-eference will be made lo some earlier research 
which see-ns to be relevant to the understanding and evaluation of thosts procedures* 

Related Research 

In a review of 263 college admission studies conducted over a ten-year 
period, Fishman and Pasanella (I96O) reported a mean correlation of *50 betv;een 
"high school grades" and grades obtained in the first year of college (versus a 
correlation of .47 between test scores and grades obtained m the first year of 
college). In the course of this review a reference is made to the work of Bloom 
and Peters m an jnpublished study in which a plan was advanced for defining, 
better, the relationships between high school grades and college averages* The 
proposed method called for statistical corrections for intraschool and inter- 
school nonequivalence of grades, and, although some writers have subsequently 
questioned the practical implications of the proposal, this early citation does 
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hi^jhli^ht the circamotance that the mean correlation of .50 letwcen "high school 
{;radc3" (HSA or riUU) and college grade-point-dvera^re (CGPA) , may be a so:nev/hat 
conservative estimate of the possible magnitade of that relationship* The re- 
viewers were of the opinion that tne Bloom and Peter.'; method, "and other such meth- 
ods," shoald serve to "clarify the real predicxive power of high school grades" 
(p- 302). 

Pishman and Tasjanella also provided an estimation of how mach test scores 
might "add" to the ofci>ervod relationships between "high school grades" and col- 
lege perfonnance* In a separate look at 21 studies in which aptitide test scores 
and "high school grades" were used in linear combination to predict CGPA, they 
noted a median increase of .0? in the correlation value. (Astin (l97l) more re- 
cently reported that when test scores are used in combination with "high school 
grades" to predict CGI"A, the increase is from .50 to .51 for men, and from o2 
to .55 for women. The more definitive Astin study was based on a national sample 
of 36,5fi' students who entered I0O different collegef3 in the Pall of I966. The 
increases here seem not large enough to be practically sigi •» ficant. ) The .nost 
commonly used tests, ii^ order of the number of times they were cited in the 
earlier review, were the Scholastic Aptitude Test of the College Entrance Examin- 
ation Board, the American Council on Education Psychological Examination for Col- 
lege Preshmen, and the Ohio State University Psychological Examination. 

TheACT Program 

- — - -J 

One of the most important examinations now being widely used in college 
selection activities in the United States was not mentioned in the Fishman and 
Pasanella review. These are the tests provided by the American College Testing 
Program. A unique aspect of the ACT Program is the recommended use, for predic- 
tive purposes, of certain data from the high school recoixJ. In particular, exam- 
inees are asked to report their last high school marks in mathematics, natural 
science, social studies, and English. These marks, along with test performance 

ERLC " 
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informtion are used sjeparatel^ to predict college averages in the fojr acddeinic 
areas, and also to predict an overall CiiPA. In the operation of the ACT Pro.^am, 
exanmeeu are a^ked to refresh me.norios, if necesaary, concerning; their last high 
achool grades in the foar coarses befoi-e prec;entin,^ themselves for testin^^ They 
are told that their inarks, as given by them^elver,, will later be reported back to 
the school. It appears th-ut these ^ijradeo are furnished with a reasonable decree 
of accuracy* 

No claim has ever been m;ide in ACT Program research reports concerning 
the special utility of hijh school recorJ information. leather, it has been ob- 
served (Lmdqaist, l^ol) that "marks made in just four selected semester units of 
hie^h ychool are practically as ^006 for predictive purposes as is the hi^h school 
jrade point average based on the entire four-year high school record of the stu- 
dent, or the rank in ^^raduatinj clu^ss based on this overall grade point average'' 
(p. 17). The observation leaves room for expecting the remaining elements of in- 
fornation on the high school record to have ^^ome residual utility for improving 
^he prediction of college po-fornance. Also, the f 0 ir self- reported grades for 
the ACT Program arc grades in the Junior year of high scliool. Generally, grades 
earned in the Senioi- year of iiigh school are better predictors of college grades. 

Other 'otudies 

There have been other studies, more recently conducted, that provide for 
the evaluation of non-test variables as predictors of college academic achievement. 
In a study at Brown University, Nicaolson (1970), for example, found that a rating 
given by high school counselors could be used "as a variable as good or better than 
those traditionally used from the cognitive domain" (p. ll). Cognitive measures 
referred to m the Nicholson investigation included the average of College Board 
achievement tests cind the verbal and mathematics subtest scores on the Scholastic 
Aptitude Test. In connection with a study conducted at Duke University, Wing and 
Wallach (1970 provided a rationale for excluding both test data and "grades" data 
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in colle^je admiGr>ions# At the University of Northern Colorado, Hein and Leonard 
(1970) employed information from the hi^^h school record in a multiple re^jression 
system that mcladed five ACT Projram ccoreo. They foand that the test scores 
made no significant, .inique contrilation to the prediction of coUe^^e performance. 

The Military Experience 

Training in the van o is military specialties approaches a level of com- 
plexity beyond that foana m some post-secondary cdacation. Since the service 
ort^ini/atior;3 must devote a considerable portion of their resources to traminr 
activities, and since training is a major element in maintaining some de.gree of ef- 
ficiency, those backjro md factors relating to pre-service edication will probably 
increase m relative importanco as military equipment and operations lecome more 
intricate. 

With most of its new men and women havin^^ at least a higli school diplotnn, 
the Air Force is probal ly in a better position than the otner mliinvy services to 
capitalize on pre-service ei.jcational information in channeling; incoming; people 
into the necessary traininj programs. 3ince 1964f accoi'din£:ly , aptitacle indexes 
(which before ]%^ had been based solely upon test performance) have included "bo- 
nus points*' £;iven for the completion of certain hi^jh school coarses. It was ear- 
lier found that coarse-completion information on five high school coarse? could le 
used to predict technical trainin^j success almost as well as this success could 
be predicted with aptitade test scores (Judy, 196O). In a later study (Jady, 1970) 
pertaining to 13»311 airmen in 24 analysis groups, it was found that for 23 of the 
24 groups there was no statistically significant difference (at the .05 level) in 
the validities reported for the aptitade information and the "education*' informa- 
tion. In this last study, self-report data on level-of-performance (as "above 
average," "average," or "below average") on a longer list of high school coarscG 
were employed, 

.> . 
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The maxiniam role of the cecondary school record in predicting technical- 
training performance in military cituations has not yet been fully explored, bat 
the military studies do demonstriite that "years of education" and "high' school 
graduation status" (graduate versus non-graduate) Jong used in large-scale mili- 
tary selection studies, are not the optiinum measure on "educational backgrounds" 
The long-standing civilian practice of dependiKg apon HSA or H3H to predict col- 
lege acadeiaic performance is, m so.ne ways, analogous to the older military prac- 
tice of depending upon "years of education" or high scJiool "grad tation stat is" to 
indicate future training sue oss^ In both settings, "aptitudes" and other kinds 
of examijialioa scores are still given the major consideration in the "operational" 
decisions* 

A final reference is made to a st ady cond acted at the United 3' les Air 
Force AoaJemy (Judy <ind riesten, 197l)* Jsinj the high school transcripts on a sam- 
ple of 30c students in th^ Class of I973f non-self-report data were assernVled, m 
a binary conf ig^iration, to shov; v/Jiich secondary courses eacii student in the sample 
had taken, and, for the courses taken, level of performano«* A point-biserial 
correlation coefficient was computed between each item of information (represented 
ly a "1" or an "0" on computer tapes), and the normalized score on academic rank 
at the Acade;r\/* Table 1 shows the distribution of the statistica,lly significant 
items of information* History and certain other subjects did not seem to matter 

Insert Table 1 about here* 

in this special situation* A p3 us sign in a column indicates that the datum was 

positive and statistically significant (at the *05 level) in its relationship 

with Acade.T\y performance; a minus sign in a column indicates that the datum v/as 

negative and statistically significant* The four levels of performance, 1 through 

4 1 was "hi^'^i" to "low" for the listed courses; a minus sign in the last column 

indicates that not having the listed course was a disadvantage* The tabulation 

-J . 
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shows the importance of ^ood pre-Hcaderv perl'orinancG in English, mathematics, and 
science on the part of prospective stadenta. The rctsaltB are somewhat less defin- 
itive for the high school foreign laf.^^uuje courses. In general, information on 
level-of-perfonnance in the listed courses w.iS found to he more i.nportant than 
course-completion inf ormation. 

In a subscq.icnt, unreported analysis, a second sample of 3C0 transcripts 
belonjm^; to student^i m tne Class of 1973 were scored using the "key" indicated 
in Table 1. A value of +1 was assigned v;hen a ti^uiscript item agreed v/ith a pi as 
valae on the key, and a value of -1 when a transcript item agreed with a min is 
value on the key. The transcript "score" consisted of the algebraic sum of all 
+ 1 and -1 values, ^1 js a constant, the constant leing equal to the nxmler of mm is 
Items on the ,<ey. It was then otserved tnat this "score" could ho used to acco^unt 
for almost 40 per cent of the vai-iation in academic performance at the Academy, 
v;hereas, in the same analysis groap, could le used to account for less than 
30 per cent. Computations wnich explore the potential role of "aptitude" tests 
t;onervilly show that such test^i can be used to account for about per cent of 
tne variation in academic performa:ace at tlie Academy (Westen and Lenning, 1973)* 

Jiarlier m this report it was noted that differences in grading prac- 
tices and standards from higli school to higii school is often given as a reason 
why it is not possible to rely upon high school grades to predict college perform- 
ance. Studies conducted at the Service Academies arft therefore potentially very 
useful in helping to clarify this particular matter on a national scale. In the 
"AcaJerrV/" studies, maximum variation in transcript format (and grade reporting) 
is encountered since the high school records come from all parts of the United 
States. By law, a systematic attempt must be made to include proportionate num- 
bers of students from designated population areas of the country. In the more 
typical college situation, students are much more likely to be drawn from a more 
limited area of the country, especially in places where an important number of 
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collctjes and .miversities are sapported by state funds* 

Procedares 

ihe procedures ased in tne present stxd^' followed quite closely the pro- 
cedares adopted for the uGaP Acadeirv/ study mentioned aoove. The total operation 
IS essentially a simple and straightforward one. It provides for the advance iso- 
lation of elements of inforrruition relevant to the prediction of a colle/je-porf or:n- 
ance criterion, and then co.nbines these elements in a manner not unlike that used 
in arriving at test scores. The resaltm^; index takes into direct account .inspec- 
ified academic skills demonstrated in earlier academic settings. (Hi^li school 
chemistry, in the Acadcir\y study, seemed to function especially v/ell in separating 
some percons with ^jood prospects for doing well at the Acadeirvj' from other persons 
with poor prospects there. In a H3A, by contrast, chemistry receives no moi-e 
computational attention than does the least demanding coarse listed on a tran- 
script.) Perhaps even more importantly, however, the index takes into indirect 
account certain other unspecified indications concerning intere;jts, intereat pat- 
terns, motivations, or proclivities of the various kind which are contained on 
the high school record and which seem likely to be useful in identifying; yo m^- 
men and women who will do well m the college situation. Clerical operatioris 
with respect to the nandling of high school transcript information in the Acadeiry 
study, and in the present study, have been described in greater detail in another 
place (Judy, 1971 )• 

Subjects 

The subjects were 1972 graduates of metropolitan-area high schools v;ho 
entered San Antonio College in the Fall of 1972. A sample of 1000 students, only 
those who had taken courses in high school qualifying them for admission to at 
least one of the colleges at the University of Texas at Austin, and those who had 
also taken American College Testing Program (ACT) tests, was selected. Pall-time 
freshman students entering San Antonio College are required to submit scores on 
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ACT, bat adinisyiofi is open (withoat rejrird to tei^t scores) to all otherwise qual- 
ifieJ persons, ocoros on the Scholastic Aptitude Tests of the College Board are 
acceptable in liea of ACT scores, but, as indicated, only students who had taken 
ACT were chosen for this stady. The 1000 students were randomly divided into two 
groups, one a key-dovelopment groap (N = 5CO) and one a holdout group (N = 500). 
The ^'holdoat'* groap was the analysis group for this study. 

The D,jta 

The key for keying transcript information assembled for t'nis study was 
gcnerateJ fro;n tritiscript data on f o ir Zrijlissh cou'ses {£ng I, Zng II, En^c III, 
Sng 17), SIX .natiie»n:ilics courses (Alg 1, Geon, iilg 11, Trig, Anf:i Geoai, iSle.n Ana- 
lysis), five social st idy courses (Ainer Mist, Amer Gov, VIorld Hist/Geog, Econo»n- 
ics, Psyc!iol/:>ociol) , and four science courses (Phy oci, Biol, Che.n, Priysics). 
Listed below are the variables chosen for this study, identified ly code letters: 

^i^Tii - L'igh School Transcript Score. The score for each student in 
the holdout (analysis) group obtained by applying the key-development ^'key," 

HSli - High School Rank score. For members oC the analysis group, 
high school rank was translated into units of measurement by first determining 
"percent position" (PP = 100(100 - .5)A0 where 2^ is the number ranked m the 
high school class, and then, assuming normal distribution, referring to appro- 
priate tables for the rank "score." 

HSA - High School Average (as in the ACT Program). For members of 
the analysis group, average of the last high school grades in English, mathemat- 
ics, social studies, and natural science, the four self-reported grades assembled 
on students in colleges participating in the American College Testing Progrnm. 
This value has been described as leing very near the average value obtained vrtien 
grades in all high school courses arc averaged (Lindquist, 196l)# 

TEIJG - Test iSnglish, ACT Program* For members of the analysis group, 
standard score on the English sub-test of the ACT Program Test. 
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T/iiiT:i - Tet3t Ilatheniaticy , ACT Fro^jram. For members of the analysis 
^Toup, staiidcird score on the mathematics sub-test of the ACT Program Test* 

T3S - Test Social ^Science, ACT Pro-am. For members of the analysis 
group, standarti score on the social science sub-test of the ACT Program Test. 

TSCI - Test Science, ACT Pro^jram. For members of the analysis group, 
standard score on the science sub-test of the ACT Pro^jram Test. 

ACTC - ACT Composite. For members of the analysis group, the corn- 
posile score on the ACT Program Test, the average of the standard scores in Eng- 
lish, Mathematics, Social Science, and Science. 

CGPA - Colleje Grade Point Averae:e. For members of the analysis 
group, average of all grades obtained in tne first semester at college. 

The Analyses 

Intercorrelations among ail variables were computed and a series of re- 
gression problems were solved for the purpobe of evaluating the utility of HSTS 
used alone and used in combination with other information of the kind normally em- 
idoyed in the prediction of grade-point-average in college (CGPA). With respect 
to the resalts obtained through the solution of the regression problems, the pre- 
dictive role of selected variables was estimated on the basis of the magnitude of 

2 

the Jiffcrenoe between two squared multiple correlation coefficients (li ), one ob- 
tained for a "full model'* (see Vlard, I962) and the other obtained for problems in 
which selected variables have been eliminated (refer to Ward's "restricted model"). 

The variance ratio (F) was used to test the statistical significance (always at 

2 

the .01 level) of the difference between the two R values. 

Results 

Table 2 snows the means and standard deviations of the variables evaluated 
in this study, and, in the iasl eight colu.nns, the intercorrelations among those 



Insert Table 2 about here# 
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Vciricibles. Code letters, as deocribed alove, are ased in identifying the tcible 
entries. Jpecial attention is called to the first column of the intercorrelation 
matrix (coljnm foar, CGPA, in Tatle 2) which shows the relationships Votween Col- 
lege GraJe Point nverCvjo (CGPA) and each of the varial los exa-nined as *'rredictor:;" 
of that measure. Tiio CCJPA-HJTS relationship (r = .^jO) was t!ie stronjest relation- 
ship observed. The CGPA-iiJli relationsnip was ol served to be .5^, and the CGPA-iBA 
relationship, .51 • (The best-v;ei jiit combination of all the test variables in this 
stUxiy led to a multiple R value of .40.) T}ie relative a-ijnitude of these partica- 
lar relationi-.hips is the matter of principal interest. In the remaining portion 
of this section of the report the predictors are evalaated, in context v/itli ono 
anotficr, m tiicir joint contributions to the prediction of academic performance. 

Teible 3 gives the sequence of regresfiion problems solved and shov;s tlie 
rcsvilts obtained. Ttie sequence of problems v;as ctii arbitrary and intuitive one, 

Insert Table 3 at out here. 

suggested and gaided by the .;.agnitjde of entries reported in the intercorrelcttion 
matrix reported in Table 2. The problems are presented in six clusters with the 
first problcin itx eacii cluster being a "full model** problem, a problem itilizing 
two or more predictors. In the ''restricted model*' problems that immediately fol- 
low eacri of the "full model" problems, various predictors are removed to shov; the 
2 

loss in H value attributable to tiie removal. The functioning of the removed 

variable(s) is thus determined. Asterisks identify the problems in v^hich t}ie loss 

2 2 2 

IS R value (i.e., "full model" R minus "restricted model" R ) is large enough 

to be statistically significant at the .01 level. 

In the first cluster of three problems it sho le noticed that even 
though HSK fimctioned better than 1I3A as a predictor of college averages in this 
study, II3A maintains some residual utility in the joint prediction of those aver- 
ages. [The High School Rank score {H3R), rather than an unsealed average ouch 
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as HSA, 18 more likely to be the "high nchool record" data lised in most selection 
oitaationo. Also, since beta "measures" pertain to the hi^h school record, and 
since the rank score is derived from average -jrades in a particir ir high school 
class, the two indications are commonly looked jpon as relating to essentially 
the same attribute,] It was found hero that when U^il and HSA are used tojether 
in a prediction system, and when each, in tarn, is removed from that system, the 
redac.ion (•0741 and .01^2) in k" (from .3335) is, m each instance, lar^e enojgh 
to bo statistically significant. The loss v/as much greater v>rhen KoR v/as removed, 
but ii does appear that some predictive efficiency is lost when only rank infor- 
mation is consKiored, and that it is not necessary to go beyond two co:nmonly-ased , 
comrrionly-ctvailable summary indications on the hig}i school record to shov/ that high 
school "rank" information, as "record" information, does not provide for the 
highest po,;':ible prediction of college grades. 

In the first problem in the second cluster of problems listed in Tcible 
3 (Pi'oblem 4)f HSK and the composite score of the American College Testing Pro- 
gram Test (AC?0) were used in a "full model" problem. Wh^r. H3K v/as removed as 
one of the predictors (Problem [>) , the H" value decreased from .3309 to .1221, a 
loss of .2033. 'When ACTC was removed (Problem 6), the decrease v/as less (.0126), 
about the same as when HSA \ ».s removed m the first cluster (Problem 3) • In the 
present instance, the results are seen to be similar to those in many selection 
situations in which a test score and high school rank data are used in linear com- 
bination to predict CGPA. Ihe contribution of the test information is statisti- 
cally significant, but the contribution occurs in the presence of a presamably- 
deficient indication pci'taining to the "high school record •" 

In the third cluster (Problems 7, 3, and 9) the High School Transcript 
Score (HSTS) is used for the first time in the prediction. Here (in Problem 7) 
ilSTS IS used with HGR in the "full model" problem. When HSTS was removed from 
the system (Problem 8), the H loss was .0461. When IISH was removed (Problem 9), 
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the loi;s was .0142. Botli locGca, thouc^h Kinall, were lar^je enojc'^ to bo statis- 
tically significant, bat HoH ernercTCs ai; the auxiliary predictor this time. H3TS 
IS objervcd to be tlie lest predictor of collcc-e-lcvel acade:]iic perfor.nance. H3H 
apparently still hao a s apple nental role to play mch as HliA does wlien rloh and 
iilSA are used together as predictors. 

In the fourth cluster of prohlc.mi m Table 3, HoT3, found to oe the Vest 

"hi6"h J.chool recor\i»» predictor, was jsed in combination vath ACTC m predicting 

aca>:nic performance in coLlecjO (Proble.a 1C). Ahcn irjTli was re-ioved (Problem ll), 
2 

the loss in the li' value of .3521, -was .2300. ihcn ACTC was re:noved (Pj'oblom 12), 
the loss was only .0019, loss not lar^re enoucjh to be statistically significant. 
ACTC is seen, then, as a variable that makes no si^r-^if icant contribution to the 
prediction of college achievement in the presence of H5TS. 

In t}je first of a fifth series of probie-ns (Problcn 13), ACTC, H3T3 
and :KK wore all three vised in a "full model" pruble.n. The full -nodel R'^ of 
.3665 declined by .O356 when HoTo was removed (Problem 14), and by .0144 when 
nZii was re-Tioved (Problem 1^). botn of these reductions wore statistically sig- 
nificant (? = 27.0/ and P = 11.27 respectively), but the removal of H3TS caused 
the greatest loss to the full :nodel Ijf^ . wlien ACTC was removed (Problem I6), 
the IC' value declined by .0021, an anoint not lar^;e enou^'h to be statistically 
significant (P = I.64). 

In a final series of problems (Problem 17 throu'^-h Problem 20), the four 
subtests of the ACT Pro^^ram Test were substituted for the ACT Pro£;ram Composite 
score (ACTC). Tins was done to allow, in the recTT'ession problems, mc?.ximum oppor- 
tunity for the selection test data to sliow residual utility in the prediction of 
CGPA. When the four testy were removed from the re^jression system (Problem 20), 
the value for the full model equation declined by .0120, an amount not large 
enoucTh to be statistically si^Tiificant. 

KJ\J 
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Dine as si on 

In interpreting the results of stidies in which comparisons are made be- 
tween two or more correlation valaes, a very important consideration always lias 
to do v/ith tiie likelihood that ran(;c restriclionu on one or more of the correlated 
measures are operating; to prevent the compariiions from being definitive ones. This 
IS trae because s ich restrictions necessarily red ice the magnitude of iho observed 
relationships, the.,e rcvljctions most often occarrin^j in sitaations in v/hich selec- 
tion proceJares aru i-zod to eiimiiiate some or many of the candiJaic:^. If criterion 
information (sci^ool-- or job-performance information) is available on only r» part 
of tne c*pplicant jro^p, then the relationships between "predictors" of the cri- 
terion information, and the criterion information itself, will pertain to only a 
part of the applicant jroup, not to all of it. It is common practice, then, to 
"correct" correlation coefficients for restriction m ran^e on the selection var- 
iables. In college admission studies tiiis is frequently done v/ith respect to test 
scores employed m :;election, bat rarely so v;itn respect to other data used in 
the selection process. Error^oas concl ;sion3 are therefore commonly reachcvl con- 
cerning the relative predictive utility of test data and educational record data. 

In the present study it was not necessary to make "cori-ecT-ions" in the 
CGPA-tcst relationships because test results are not used in makinf; admissions 
decisions at 3an Antonio College. There was no restriction in range Iroujht alout 
ly selection on test variables. The restriction in range on the educational var- 
iables (i.e., the elimination from consideration of t)ie recordf; of studentr^ who 
had not taken all the high school courses necessary for university admission) 
was a planned part of the research design. In the sampling operation the goal was 
to come up with a group of young people who would resemble, as closely as possible, 
persons thought likely to be Ccindidates for uTSA admission in the Fall of 1976. 
Establishing of minimum educational background requirements served to identify, 
better, a potential UTSA applicant gr -up. 
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A reduction in raiiije on test scorers, however occasioned, and whether at 
the lov;er enJ of the "aptitude" scale or at the hi^jher end, operates to reduce the 
.narjn^itudc of tne reU^tionshipr, that can be reported between thoj;e scores and the 
criterion at hand. The reference here to the "higher end" of the scale as not on- 
ly to the somewhat better test perf or:T:ancc of the students at some of the private 
collejos in the San Antonxo area, but also to the better perf orriKince of an jriknown 
nanber of Ltadentb ;;ho now leave the metropolitan area each year to attend collejes 
and aniveriuties elsewhere. With tne openmj of to mderjrcsd late enrollment, 

tio.ne of the nijhor ir.corinj hxjh sciiool r.t,idonts will pi'olubly choo:5C to apply for 
LTo.'i ad'nii;i;ion. Miny othcrii m the higher "aptitude" cater;o^y> o:;pecially those 
who can ai'foi^ the extra expense, will probably continue to mi^ivite. Tliere m 
some evidence that students at the new urban campuses bein^j established ly state 
univeroities in the Initod States represent a different strata of American society 
than do Die students at the cer.tral campuses, and especially the students at the 
more selective pi-ivatc institutions. 

The heterogeneity of a ^roup on one variable aff ^';ts the ma^^iitude of 
the observed relationship between that vaxiable and any other varialile. Anoi/ier 
factor which is of £;o:ne importance is the reliability or stability of the corre- 
lated measures. The accuracy of prediction that is possible to achieve is lim- 
ited by the reliability of the variable used as a predictor. In particular, in 
interpretinj the results of this study, and in considei-jng their implications, 
it appears necessary to take in-*.o some account the possibility of obtaining im- 
proved data on the educational record. In the San Antonio area, it was noted in 
the course of the stidy, there is a rather serious deficiency with i^espect to the 
lack of standaixl pj*actices and procediii'es in keeping educational records, and 
this extends to the supposedly simple matter of arrivin^j at grade averages upon 
which "hign school rank" is based. 

At some San Antonio higli tichools, when grade-point-ave rages are computed, 

ERIC 
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all (jr-uJcb on the transcript are averat'ed, incl idinc; those earned in varsity ath- 
letics (almost all tj jch {;radec are "A'Oi i^and , K.O.T.C., and Driver LWication. At 
other hiijh schools, some of these are mcl uicd. It was surprisinj to find schools 
m the i^arne District, preou.nably following; written policy set do\/n by central 
administrative office, differing fro:n one other in the coarse ^;rades incl.;ded m 
the averajCG. Tins lant Vtuiation, hov;ever, was m ich less than variation in pro- 
cedure fro.n District to District. It was also observed that there is a definite 
need foi- a^'iit and review procedarcs to identify, and to insure the correction of, 
conp ilational error^s. In the data asscnilled for tniis stady, the observed errors 
were certainly not rare. 

Anotncr pracLice, also somewhat dilTcront fro:n District to District and 
fro:M school to schoo] , bat witn dii'ferent i:nplic^* t j ons for different students m 
the sa.-no District, or the same school, was oiiO tnat assi(;,7is a different nunlcr of 
tirade points for st.idents .-iiaicin,'; the same ^T^Mue in diffei'ent presentations of the 
sa-:te coar.so. At one hi^^h school, for example, vinero a sewcr.-pomt scale is used 
co:npjtinj c t5i*^de-point-avcra-;:e for each stadcnt, tixe grading; v/as as follows: 



ririi'iched Co.irse Hegalar Co ;rr.e 3aslc Course Grade Points 
A 7 

h H 6 

c 5 

D C A 4 

D B 3 

C .2 

D 1 



A majority of San Antonio schools employ variations of this plan. It was ob- 
served, too, that most of the students in "enriched, ''major works," or "honors** 
courses receive "A" or "B" for their performances v/hereas many of the students in 
"basic" or "developmental" courses tend to receive "C" or "D." Only in the "reg- 
ular" courses are near normal distributions of grades sometimes found. The im- 
portant thiM^: to notice, overall, is that different scales in different schools 
are * ^: di f ferent studerits m essentially different courses. 
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In thiG utady, ay already indicated however, hit^h school "rank" data and 
"^radey" data, in their prctjent condition and forwit, were .ised in the prediction 
of college pci'lor-Tiancc, No effort was made to rccornpatc "rank" in tlie v.^rioas 
hii^h schools on the bayis of a common r>et of coaruje cJ^'^^J'^"'^* (not possible without 
t\e entire niiiber of records of a jiven high school jrad iatincj clasj;)i or even to 
coi-recl the errors made m coinputinj jrade averages on wiiich the reporleci **rank** 
was based. No allowances of any kind were made for tMe circumstanct.- that -^ra.dcs 
pertaminj to the "same*' coarse are often taujht at different levels, and eval i~ 
atcd differently for different slidents. As point.; of dr-partare for determining 
"iiii;h scaool rank," or for the derivation of "iii^'h school transcript score," it 
IS apparent that the available datci v;ere some.;hat less preciric tlian tliey -ni^'ht 
otherwise be, and tnat, m tiiis particular respect, they are chai-acteric^tic ol 
earlier data of the kind normally itilized in collee>;e admission stuUes* 

If test information has no incremental validity m the pi-cscnce of in- . 
dex»:j derived from "hijh school record" d:\i<^ of the quility cwailalle for this 
slady, rco-iltc jhojld be ^o.t • /hut .norc conclisive with letter inf oi'.nation fro.a 
those record... ai,-;a scr.col "lunk" data, because they can be used to force a si.;i- 
ilar distribition of rank "scores" i'or the different hijh schools, si.o Jd .jeu;j-- 
ally predict coile^je ^^radcs better than nijn school "averages." The fmdin^^s of 
this study support the pr.^ctice of usmj "rank" information, rathei' than avera^je 
Si-adcs, if only one of these are to bo employed in m.'ikin^; coHqq^ admissions de- 
cisions, hank scores are probaliy more "fair" in certain areas where high schools 
differ considerably in the social, economic, and/or racial compositioii of their 
student bodies. 

Summary and Concl ;sions 
This report be^Mn vath an observation tiiat colle^^e admissions is now 
a critical problem m many countries. In the bnited States the administrative 
trend has been toward the expansion of facilities for hicher education e;o that 
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larjer namberG of yoMii^ people rniijht be able to c^ttend c>o.ne colle/je or university. 
In the Auorican sitj.-ition, tiie priiicipal conteat if5 incredGin^^dy becominj n.n an- 
nx'tl conteMt for admission to one of the "tietter" inGtit.i lions* The intensi fvin,^^ 
competition IS not yarprisin^^ in view of the expanding awareness of the economic 
and social advantages that accrue to yo in^i people who .ittend the more selective 
schools. When some applicant;j are admitted and some are rejected, hov/ever, the 
qaestion often asked is: How are theii;e decisions made? Or: How sho xld these 
decisions be made? 

A widely accepted point of view is triat the fairest bctsis for colle^^e 
admission? is one on merit that favorn applicants in accordance with the best 
possible estimate of their relative prospects for doin^; well in a particular aca- 
demic setting. It has generally been sliown, in h mdreds of studies on the topic, 
thc'it the "hiji: school roooixi" is the best sinjle predictor of collc^e-ievel 
achievementj and thcit the best predictions are made when "hi^ii school record" 
information ^uven more wei^rht than selection-test scores when admissions de- 
cisions are made. In actual admissions practice, howovei*. Lest scores are often 
i^iven the moiU effective weight. In the first part of this report, fo ir main 
points arc made in connection with the past studies on colle^re admissiono. 

1. The "average" grade shown in jrade-point-averages, which determine 
"rank"' m higii school cleiss, may not adequately s^immarize the heterogeneous con- 
tent of the high sch.ool record. An "average" grade masks important differences 
with respect to tne courses students take. The lack of standard approaches to 
the computation of averages, and the common scarcity of effective review pro- 
cedures for correcting ordinary computational errors, also contribute to the un- 
reliability of "high school grades." 

2. The recommended ratios for weighting test scores and "high school 
gradr-^" are empirically derived. VJhatever the deficiencies in grades or grading, 
the recommended ratios reflect the existin,-; utility of the data in bent-weight 
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prediction equations. It is often orroneoifjiy inferred that, relative to "hi{;h 
tichool o'i'i^**"/' teot t;coroy arc .norc deporulabiu .^nd valid for ijeloction purpoiieo 
becaaue of icnown differcncea in c^ixdin^ practicet; and standania. There are lif- 
forencov, m these practices and standard::, b.jt the differences, tho ijh siomoti nes 
l^rcjt^ are not trenorally lar^^c onoj(;ii to j.istify the nc,-:ative inferences corninonly 
nade. 

3* ^)vea the best vveijhls jiven to the loot c irrent predictors do not 
pernit forecasts of collcjo achiove.ncat thai arc partic ilarlv r.cc uvite. Act lally, 
not .noi'v:? t!ian aboal a third of the variatioii m collei;c perfoi'm-.nce can /^enor.-illy 
be itreJictcd tnro_;,;a tiic use of test scores and "ui^^n school recoul" infor^natioa. 
This Ic.ivej :n.<CM roo.n for improve ncnt in the prediction of colle^^^e-levcl aciaeve- 
inent, 

4. Historically', for the purposes of acadeinac prediction, more atten- 
tion nas been jiven to tiie ncasarejient of *»intciii jenoe,'' "inental abilitys" iind 
"seaol..olic aptil-id^V* tiian to tno qaantif ication of eqiivalont a-nojnt of data 
cbtainallo fro.n trit- oxistinj ac<ulc:iic recoxJ, d^jta oxtendin^^ over ,i lon^jer r.=^u.nple 
of an iadi vii.:..l'r. f .uioti ojiin.; tnan tv/o or three ho irs of test behavior. Almost 
no effort h:,r; leen devoted to the identification and q ia.ntificcj tion of si6*"ifi- 
cant ite.nt*. of mforn.tion on sciiool records, or to the identification of itens 
winch saoaid be ^^ivi::! effective woijht m aiu-ivin^* at a su.nmary record ••score." 

In cTivinj the objectives of tlte present study, it was pointed o.it th.;t 
the opening of a .nijor urban miversity in San Antonio, Texas, ir. }ii£;}ili^;htin^: a 
perennial coUeje ad-.iissions issio that iias not been satisfactorily resolved any- 
v/here, and thvat the total situation m iii^her education m this location is some- 
wiiat tuialojous to the current situation m higher ed ication m the State of Texas 
as a whole, and, to some extent, m tiie nation tis a whole. In the study carried 
out, the focus of attention was upon standards and policies that govern admission 
to post-secondary education. In particular, these questions were asked: l) V/ith 
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respect to istundaixiij winch liorvc to predict collCtTe performance, do the acce])ted 
^jenerali^atiOMG nold waen it couies to the relative atiiity oV teot ijcorea and in- 
formation fro.ii trie nijh scnooi record? 2) Does trie ur>c of a hi^jh school *\7radc- 
point-uvoraje" (HJA) or ra:irc l.ised on that avera^je (iilih) lead to crroueo.ic con- 
ciusiono conceriiinj the :naxima;n predictive utility of measuics derived fro.n t)*e 
previoa.i acade.aic record*; 

A inch school trarhjcript score (liofS), a hypothetically better "meaaaro 
perlaiaiaj to tne hijii school recoixi, x^uo jL;nerated and evaluated m context v/itii 
otiier laror.nation of tiic kind nor.-nally employed m raakiino reco.nrr.endatious and de- 
cisions on college adnissions. It was found thfit neitner a iii{;h sciiool Jr^iJie- 
point-:ivcr.;jc (aJA) nor a niti'h school rank (tlJit) provided for tne optii-nuii predic- 
tion of coilojo ^^rade.^. woz*e specifically, it was f o md tiiat: 

iiit^h Sch ool rank mf oraatiofi, in the precision shown on hi^^rh school 
trani.crii)l.> ex'tmined in this study, docs not provide for the oplimura prediction o 
coller;*.- jrades. Hi^^h school rank is clearly a belter predictor thc^n hi^jh school 
avura^'O (tnis does not agree with an iuiorican Ccllcijc Testing* J'rojra.:i slatcnent 
concerning: t*:e relative usefulness of an approxi.aate "avera^je" and hi^h school 
rank) I ut tne A.nerican Colieje Testmt^* Program "averac;:ti" does .-naintain so;ae pre- 
dictive utility in the presence of hijh school rank. Tins is taken as one indi- 
cation that there is predictive mforination on hi^h ichool transcripts net now 
beiri^ systematically employed. 

2* Hig.h ^iohuul r.tnk mf ui'.na lien , in the precision snown on transcripts 
examined m this study, maintains predictive utility m the presence of the Amei'- 
ican Colle{;e Testm^; Froe^ram Composite iScore, bat the test information also main- 
tains predictive utility when test scores and hi^jh school rank, in the precision 
generally reported, are used m linear combination to predict college ^a'iides* 

}• Hi^^h school rank information, in the precision shown on transcripts 
examined m tins study, maintains predictive utility in the presence of the ex- 
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perirnontal "lujh uchool transcript ocore." High school rank, although not a bet- 
ter predictor tnan the "hijh school transcript score," shoild be retained as a 
component part of the high school record information when attempts are made to 
predict colleje ^Ji'adea. 

4. In the presence of a hiS\ scitool trant^cript ijcoro , as developed ?ind 
evcilaated in this statiy, the American Colle^'e Testing Pro^jran Co-npo.jite Score 
maket; no etatii^tically significant contribution to the prediction of colle>;e ^^raJes* 

V/hcn hi^li school rank information, the ta^h sciiool ti-ansci'ipt score, 
and the A.noi ic.ia CollCt:;e Testing Pro^jram Composite Score are jointly ised to pre- 
dict colle^'u grades, the removal of the hi^h jjcliool trarjdcript score from the pre- 
diction c.iui;e;j the ^^roatest loss, the removal of hi^jh school rank causes a lessor, 
thoaj}i still a statistically si^jnificant, loss. The removal of the American Col- 
lege TestJ nj Pro^^ram Co;:ipDGite Score did not cause a statistically si^jnificant 
loss. 

6. The four sub-tests of the /imerican Colle^^e Testing Progi'am tests, 
in line^tr conbination v;ith hijh school rank information anu the hig^h school tran- 
script scoro, do not contribate, statistically, to the prediction of college ^jrades. 

It IS therefore observed, then, that in makinj college admissions deci- 
sions and recommendations, it is generally best to use a carefully obtained lii^ jli 
school rank m conjunction with an empirically developed hif:h school transcript 
score in the prediction of college achievement. In the presence of these two in- 
dexes, used jointly, selection test scores become redundant. 

Recommendations 

The recommendations offered below, although these must necessarily 
pertain particularly to the situation in higher education in the San Antonio,. 
Texas, metropolitan area, are ones tiiat have direct implications for educational 
practices and policies elsewhere. The problems here are problems common to 
higher education. Many issues remain unresolved. 
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1. Since hijh ::chooI rnnk la widely employed in coUeijc admissions dcci- 
Jionfi, and cmce th;it information ali.;o inamt/unr, predictive utility in the presence 
of a more co.npre;»enGivo hi;;?! i^chool tr..nr>crii>t score as developed and evaluated in 
this stidy, it IS recoinrnended ti.at more ce\re and precision be as widely exercised 
in ol taininj and recording "hijh school rank" information. The most obviois need, 
in field setting's s ich j.s the one in wlach tho present st idy was cond ictcd, is a 
co.Trnon policy covormj the identity of tne uijh schooi courses ihhi are to be iced 
wiiori hi'jh iic/iool jnde-poi nt-a^erajec; are coinp iteJ , and those that are not to be 
used. In Texas, the courses pror.^i) ly should Ic selected, not arbitrarily b it 
exci isivuly, fron the "list of approved co u'ses*' m Bulletin 56O of the Texas I'd- 
jcation Ajency* It is alaiost anb'.^"! levabie that re^rents, or tristees, of public 
collojes and univei oi ties in a dcsi(;riated ar^^a arc able, ratlier independently and 
unrelated ly, to t»stablish /idtnissions standards for entering; students, that these 
p3*o:rtincMlly inclufie indicalions on "hi^h scliool rank,*^ cind that there is )io order- 
ly t apocified plan, and a formal oiditm^ procod.ire, which mi^ji^t effeolively con- 
,j'ol \nv v;aj tTrado-pomt-avcrajes arc obtained, ili^h school ranlc is based upon 
thooo i 1^ jrt.,nt aveia^^e:;. It seems iruperativo that eaz^ly steps be taken to re^- 
ulari:'0 this non-trivial matter. 

2. The first reconmendation docs not depend entirely upon the results 
of tiic present study to make it an appropriate one. The second recommeiidation, 
likewise, is not alto^^ether an outgrowth of the results reported here. There 
does seen to be a need, however, for soae kind of a moratorium on the proHfcra- 
tion of courses taujJit at two or three levels in high school, and of special 
courses open, in fact or in effect, only to those with "talent" or extra money. 
It \70jld appear that the twin pressures of opatnik and a lingerinc non-acceptance 
of court-mandated desc^jrejation may have had some added influence on tlic actual 
practice in many places, but it is really not otherwise clear why Course 1 of 
Subject A (Aljebra 1, for example) should be tau^'ht at a "developmental" level. 
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a "rcjaicir" level, and dt an "aonora" level, aGsarninj Uiat Cour;;e 1 covera a I'lnite 
na.aler oV conccptii Trorn the topic of ojbjecl A and il it; a prc-rcq lusite foj* col- 
lc^;e ad.nist;ion. Jntireiy apart from the rationale for ao.;i^:nin(;: studento to the 
differo.'it clai^Gey for 'Jjin^e 1 of .^abject A ic the :natt<:r of teachcrii hemj alio to 
co.uc xp ;/itn j^-radej m Coarse 1 li.it will ;-5atisf<xCtori ly c;nd accurately relate tr^c 
perfoi-iuince of i,taae:ito v/ho nave received motractio/i in the dii'l'crv nl ci'i.;.iL;fj . 
(Tiiure are, pornapj, .va^/j th.it one ijtadcnt, rather t}ian anoliier, c.ui Le allowcvi to 
projrotjj to a hit:nci' level m tii(? J abject A Orrical .^.n, bit thiu slio *id not operate 
to dcoealuile or Coi*ceal relative performances of tjtudent:^ in the I'lrj t ooarae m 
^;abject A.) Another critical i>itaation, wpccif icaliy , ig triat a Larc:c nanbtri* ol* 
oan Antonio stadv-nti;, inore than a few oV wno.n wo iid .appear to ii.-tve >;ood pj*o;\:;ect.i 
for uoin^: woll m post-i:econdary edacition, rej.ilaiiy .jrad.iate fro:n ni^^h r,ci.ooi 
without navm^j taken the required couri^eo for a noj-inai entrance 3nto one of tne 
"better*' coliejcii. nclated KalhciiiatiCG 1 and helatcd lin tne.irit] co 11, for eKarnpje, 
.neet tne req iire.jien for hifjb ijchool jradaatjoii in ioxab, hxi no I Irto acauejuc 
rcviaa rc.iifr.tw for co]ieje entr j.ico la "Letter" mi^ti t j1 icny anywlicre. 

3. Vlie tnii\i reco.nrncndation ii; orie that lollowi; quite directly i ro:n tl.o 
findm,-;:: of thi3 .st hly. It lii tliat tape fileu be o.aal 1 lur.cd at Hie 'Jnivojoitv 
of Texa;; at 3an Antonio tfiat will coatam the f^ll sccondar^-jchool reco]-d ol' (j xo\i 
applicant for adrniijiaon, ami that theiie specif icallj' mclado the iieeondary-nchool 
records* of third-yeai' and e r ^;r ad uate stadcnts; who plan to enter uVJA ii the Fall of 
Then, umce a record of the previous andcrjradaate work will aljo be at hand, 
a key can le easily and conveniently developed that will relate hijn cchool per- 
for.-nance to the earlier college achievement, whcrev^^ dc.nonijtrated . Tliia key can 
then be ur.cd in the derivation of a ti-ial "hi(^h school tranncnpt iicorc" foi- the 
applicants i'or the 1'//6 frcyhman class. 

The adoption of thin last recommendation will permit not only a repli- 
cation of Go:ne parte of the preiicnt study, but also make pounible other derarable 
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coinpatatiorij (aiiinj tiie LaLiXC data from ni^^ii school records) • Not m^ch can bo done 
to rcco.npatc tr.e hijii sichooi "rank^^ of a ^ivan student ( iniuss all the records of 
a {jiven secoadary-ijchool arc on hand) bat the bcloctiori of courses to be included 
m c> hi^jh school "averajo" con Ic made v/itho^ reference to tliC varymrj practices 
fx'O.n hijii school to hi^^h school m coaiputmj averajes* iCvcn on the :natler of 
courses tauj/it at more than one "level,'* additional variables can no jonerateJ to 
reflect the var^^in^:; circumstances, and to aid m isolatm^r the additional predic- 
tive role, if any, of the available mforinatioa ou ex.istinj secondary-f;choo] re- 
cor 

KiHcdiy, and perhaps most i:f.portantly , the adoption of the last reco.nrnon- 
dcition of U.i;, report will per.nit not only the development of "hi^^h sc.ooi racord 
scores" WiUC:i will provide I'or liie optirnum prediction of overal 1 acc^dcmic achieve- 
meat at v^'^Jii but also mcreasm^^ly-accurate "::.cox'es'* whicii will provide for tne 
optiir^.rn prediction of acaicvement xn Inc sop ;rale co.a'ses-of-study at urJvi, all 
i;ithout any n^'Cessary reference (so.T.eti .nes uiif<-ar and harmful) to •*aptit.Kie" or 
*'iibiiity/» or "inteili jence." If admissions decisuns cau le made on an educa- 
tional-projram or a course-of-study basis, arid there arc pai'allcl ucvelopments in 
the ot/icr colle^-es and universities in the Jan /mtonio metropolitan area, it sho ild 
no loiijer be necessary to view tliese institutions as beiiij in an 'Maerarchy'* vatii 
respect to one another, or witn respect to institutions of higher education else- 
where • 
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Table 1 

otatioticaily Jijruficaat IteiniS of Infor n.ition l'ro:n the :li^;n 'Jchool hecord 
wnich Pi'oJict Acade.Dic Oi-dor-or-Zierit at tho Air Korce Acadcny^ 



ocnooi Level of Perror.ncuico in ^^oirse CoartiO llol 

Coarse 1 if 3 4 Tukeii 



hljijlii^h ii (iecoxid Gouroo) + 

i:Iii/;ii:>ii 111 (iiiii-a Course) + 

ivijlish IV (i''Ourlh Coai-je) + 

I'-'aln 11 (ricino JcojjOtry) + 

M.ith 111 [Adv. Al^;. , Tri^O + 

I'iath iV (l'iloi*a# Analyi5}:j) + 

Auiii V (Tiie Calculus) + 

Biolo^;/ 1 (rtrist Course) + 

Cne:nislry 1 (i^'iriit Course) + 

Fh^jjiCG 1 (rii'ist Coax'se) + 

A i<o.nnnce Lunjua*ve 11 + 
A ){o.:Ktnce Lanej.iu^.jc 111 
A uo.^Kince Lanj .*Lje IV 

A i\' oil- Latin Lancjaa^^*. II + 

A Kon-Latin Larit^jua^^e III + 
A Non~Latin Language IV 



Adapted from Jud^ and Westen (1971)* A '•pluG** indication sliov/y that 
the ite.n of information was positive cind statiiitically si^jruf icant at the .Op 
level. A '*ininus" indication shov/s that the item of information v/as ne{^Htive 
and statistically significant at tiiat level. 
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Table 2 

Vai'iallcG (Lifted by Code^) oiiowirieJ Means, 3t»mdcird Deviations, 

and Intorcorroiations 

(leased on records of ^jQO Jan Antonio Coile^;e ytadent:^) 

Cdi*fi i:«l;4 •74 

31>O0 d^^ij ,59 







15.19 
















riJA 


2.67 


.63 




.79 


.76 














J . 


.33 


.''.^ 


AO 


.41 








X ."*f I i. . 1 


• 3. /3 


6.^2 


.33 


.ij3 


•4o 


.46 


.51 








17. 1J 


6.95 


.21 


. j9 


.31 


.36 


.61 






loCl 


1 ^. \^ 




.V.2 




.31 


.37 


• 55 


.56 


.71 


- ^1 • 


ici. 14 


b.1l 


.35 


.1)3 


.44 


.A6 


.79 


.73 


.37 



See text for idontificutio/i of v<xriabloy. 
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Table 3 

iioquence and itcsjaits of Ke^jrecision Problems 
{•A = 1,00) 



Predictors i:i Probiom" ii loaa 

.>o. 



1. 














.Ion 






.074 i 




^ • 




T'i^lftOVt*ti i 




.VI 


11 'iiti-'t 


4. 




ACVO (i'uli i-iOdci) 


.3309 






c 


ACi'C 


(;iJK reiitovcd) 


.l?i>l 


.2033 


15,5. 09*^* 






^ i I u ; r c :r. o Vu c: y 


.31?-3 


.CI 26 


9.36*" 


V. 




lioTo (r*ail *%0'iel) 


.3644 






o. 


fiJK 




.3133 


.C46I 


36.01;'' * 


9. 


Ho To 


rcnovod) 


.3502 


.0142 


1 1 .io«* 


5u. 


tl.i X .3 1 


.i'JiJ ^^'ali *iodcl) 


.3i;21 






11. 


/\vJi J 


^riJTJ 2'O.iiOVca) 


.12^1 


.'/3OO 


176.43'''' 


1.:. 




(riCTo rc.noved) 


. 3L»cr 


.cci;^ 


1.46 


13. 


IaS'x o I 


:;oii, ACVC (i''ali *'lodcl) 


.360i; 






14. 




ACrC (libTJ reaoved) 


.330^; 


.C3i)ii 


27.07** 


b. 


HdTo , 


ACTG (HoK j*o.iioved) 




.0144 


II.27X-* 


16. 


ilJTS, 


Ho}\ (ACTC rcuovcd) 


.3644 


.0021 


1.64 


17. 


il3TJ, 


fIo:t, TKiiG, IVLWii, Too, TJCl 


.3764 






Id. 


HJ}i| 


4 Teats (iloTS removed) 


.3396 


.0363 


29.09** 


19. 


HSW, 


4 Tests (iioK removed) 


.3644 


.0120 


9.49** 


20. 


H3TS, 


iLSK (4 Tests removed) 


.3644 


.0120 


2.37 



See text for identificcition of variables. 

V statistically sic^nif leant at #01 level. With r and (]J - £) dc^^rees 
of freedom, where £ is the rank of the full niatrix of predictor scores, and r 
is the difference between £ and the rank of the matrix of the predictor scores 
after the variables iiypothesiiied to have parameter woignts of 0 have teen re- 
moved (Ward, 1962). 



